Endoscope apparatus

ABSTRACT

An endoscope apparatus includes: a video signal acquisition portion that images an object to acquire a video signal by a stereo optical system; a video signal processing portion that processes the video signal to generate a display video signal; a measurement processing portion that performs measurement on the basis of the video signal; and a display portion that displays the display video signal. The video signal processing portion generates the display video signal by extracting one image from the video signal including a plurality of images from the stereo optical system, and the display portion displays the display video signal including the one image extracted by the video signal processing portion during a period regarding measurement. The measurement processing portion calculates a matching degree between the plurality of images at a position corresponding to the measuring position. The display portion displays the matching degree together with the display video signal.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation application based on a PCT PatentApplication No. PCT/JP2008/067824, filed Oct. 1, 2008, whose priority isclaimed on Japanese Patent Application No. 2007-281641, filed on Oct.30, 2007. The contents of both the PCT Application and the JapaneseApplication are incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an endoscope apparatus in which aplurality of optical systems can be mounted.

2. Description of Related Art

Industrial endoscopes are used to observe or inspect inside damage,corrosion, and the like of a boiler, a turbine, an engine, a chemicalplant, a water pipe, and the like. Industrial endoscopes have aplurality of kinds of optical adapters prepared to observe and inspectvarious objects, and tip portions of the endoscopes can be replaced.

An example of such an optical adapter includes an optical adapter forstereo measurement which forms two left and right fields of view in anobservation optical system. Japanese Unexamined Patent Publication,First Publication No. 2005-348870 discloses an endoscope apparatus thatuses an optical adapter for stereo measurement, calculatesthree-dimensional spatial coordinates of a subject on the basis of thecoordinates of left and right optical system distance calculating pointswhen a subject image is captured by left and right optical systems withparallax using the principle of triangulation, and performsthree-dimensional measurement (stereo measurement) of the subject.

BRIEF DESCRIPTION OF THE INVENTION

According to an aspect of the present invention, an endoscope apparatusincludes: a video signal acquisition portion that images an object by astereo optical system to acquire a video signal; a video signalprocessing portion that processes the video signal to generate a displayvideo signal; a measurement processing portion that performs measurementon the basis of the video signal; and a display portion that displaysthe display video signal, in which the video signal processing portiongenerates the display video signal by extracting one image from thevideo signal including a plurality of images from the stereo opticalsystem, and the display portion displays the display video signalincluding the one image extracted by the video signal processing portionduring a period regarding measurement, the measurement processingportion calculates a matching degree between the plurality of images ata position corresponding to the measuring position, and the displayportion displays the matching degree together with the display videosignal.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a perspective view of an endoscope apparatus according to anembodiment of the present invention.

FIG. 2 is a block diagram showing the functional configuration of theendoscope apparatus according to the embodiment of the presentinvention.

FIG. 3 is a block diagram showing the configuration of a control unitprovided in the endoscope apparatus according to the embodiment of thepresent invention.

FIG. 4 is a flow chart showing the procedure of an operation (entireprocessing) of the endoscope apparatus according to the embodiment ofthe present invention.

FIG. 5 is a reference view showing a display screen of the endoscopeapparatus according to the embodiment of the present invention.

FIG. 6 is a flow chart showing the procedure of an operation(measurement processing) of the endoscope apparatus according to a firstembodiment of the present invention.

FIG. 7 is a reference view showing a display screen of the endoscopeapparatus according to the first embodiment of the present invention.

FIG. 8 is a reference view showing a display screen of the endoscopeapparatus according to the first embodiment of the present invention.

FIG. 9 is a reference view showing a display screen of the endoscopeapparatus according to the first embodiment of the present invention.

FIG. 10 is a flow chart showing the procedure of an operation(measurement processing) of the endoscope apparatus in a modifiedexample of the first embodiment of the present invention.

FIG. 11 is a reference view showing a display screen of the endoscopeapparatus in the modified example of the first embodiment of the presentinvention.

FIG. 12 is a reference view showing a display screen of the endoscopeapparatus in the modified example of the first embodiment of the presentinvention.

FIG. 13 is a reference view showing a display screen of the endoscopeapparatus in the modified example of the first embodiment of the presentinvention.

FIG. 14 is a flow chart showing the procedure of an operation (entireprocessing) of the endoscope apparatus in the modified example of thefirst embodiment of the present invention.

FIG. 15 is a flow chart showing the procedure of an operation(measurement processing) of the endoscope apparatus in the modifiedexample of the first embodiment of the present invention.

FIG. 16 is a flow chart showing the procedure of an operation(measurement processing) of an endoscope apparatus according to a secondembodiment of the present invention.

FIG. 17 is a reference view showing a display screen of the endoscopeapparatus according to the second embodiment of the present invention.

FIG. 18 is a reference view showing a display screen of the endoscopeapparatus according to the second embodiment of the present invention.

FIG. 19 is a reference view showing a display screen of the endoscopeapparatus according to the second embodiment of the present invention.

FIG. 20 is a reference view showing a display screen of the endoscopeapparatus according to the second embodiment of the present invention.

FIG. 21 is a flow chart showing the procedure of an operation(measurement processing) of an endoscope apparatus in a modified exampleof the second embodiment of the present invention.

FIG. 22 is a reference view showing a display screen of the endoscopeapparatus in the modified example of the second embodiment of thepresent invention.

FIG. 23 is a reference view showing a display screen of the endoscopeapparatus in the modified example of the second embodiment of thepresent invention.

FIG. 24 is a reference view showing a display screen of the endoscopeapparatus in the modified example of the second embodiment of thepresent invention.

FIG. 25 is a flow chart showing the procedure of an operation (recordingprocessing) of an endoscope apparatus according to a third embodiment ofthe present invention.

FIG. 26 is a flow chart showing the procedure of an operation (playprocessing) of the endoscope apparatus according to the third embodimentof the present invention.

FIG. 27 is a flow chart showing the procedure of an operation (recordingprocessing) of an endoscope apparatus according to a fourth embodimentof the present invention.

FIG. 28 is a flow chart showing the procedure of an operation (playprocessing) of the endoscope apparatus according to the fourthembodiment of the present invention.

FIG. 29 is a reference view showing a display screen of a knownendoscope apparatus.

DETAILED DESCRIPTION OF THE INVENTION

Hereinafter, embodiments of the present invention will be described indetail. In the following embodiments, the same constituent componentsare denoted by the same reference numerals. In addition, a repeatedexplanation thereof will be omitted.

First, the structure and basic operation of an endoscope apparatus willbe described. Next, among operations of the endoscope apparatus, anoperation of measurement processing will be described in first andsecond embodiments and operations of image information recordingprocessing and image file play processing will be described in third andfourth embodiments. The measurement processing, and the imageinformation recording processing and the image file play processing maybe separately performed. Therefore, the first and second embodiments,and the third and fourth embodiments may be combined arbitrarily.

Hereinafter, the structure of the endoscope apparatus of an embodimentof the present invention will be described with reference to thedrawings. FIG. 1 shows the appearance of a measuring endoscope apparatusof an embodiment of the present invention. FIG. 2 shows the functionalconfiguration of the measuring endoscope apparatus of an embodiment ofthe present invention. FIG. 3 shows the functional configuration of acontrol unit provided in the measuring endoscope apparatus of anembodiment of the present invention.

A measuring endoscope apparatus 1 of an embodiment of the presentinvention images an object and measures a geometric characteristic ofthe object from the image. An examiner may appropriately replace anoptical adapter on the tip of an endoscope insertion portion,appropriately select a built-in measurement processing program, orappropriately add a measurement processing program in order to performvarious kinds of observation and measurement. Hereinbelow, a case wherestereo measurement is performed as an example of measurement will bedescribed.

As shown in FIGS. 1 and 2, the measuring endoscope apparatus 1 isconfigured to include an optical adapter 2 for stereo measurement, anendoscope insertion portion 3, an endoscope unit 7, a CCU 9 (cameracontrol unit), a liquid crystal monitor 6 (display portion), a remotecontroller 5, and a control unit 4.

In the optical adapter 2 for stereo measurement, object lenses 2A and2B, which are disposed to be spaced apart from each other by apredetermined distance in order to acquire images with parallax, aredisposed within an adaptor body 2 a having an approximately cylindricalshape. The optical adapter 2 for stereo measurement has a mountingportion 2 b formed with a female screw and is detachably mounted on thetip of the endoscope insertion portion 3 using the mounting portion 2 b.

The positions of the object lenses 2A and 2B are different depending ona direct view type that has a field of view at a tip surface of theoptical adapter 2 for stereo measurement in the axial direction thereofor a side view type that has a field of view at a side surface of theoptical adapter 2 for stereo measurement. In the present invention, thedirect view type is shown. Accordingly, the object lenses 2A and 2B aredisposed near an incidence opening provided on the tip surface of theoptical adapter 2 for stereo measurement with optical axes thereof alongthe axis direction of the optical adapter 2 for stereo measurement.Moreover, an illumination window 2 c that causes illumination lightguided through the adaptor body 2 a to be emitted toward an object isprovided on the tip surface of the optical adapter 2 for stereomeasurement. Note that, although the present invention is describedusing a stereo optical system having a dual lens, the same effects as inthe present invention are also obtained in an optical system thatacquires a stereo image, such as a prism. In addition, although thestereo optical system is provided in the optical adapter in the presentinvention, the stereo optical system may be provided in a tip portion ofthe endoscope insertion portion 3.

The endoscope insertion portion 3 is inserted into the inside of theobject to image a region to be measured and then transmits an imagesignal to the control unit 4. A tip portion of the endoscope insertionportion 3 is formed so as to be capable of bending, and a mountingportion common to a plurality of optical adapters, such as the opticaladapter 2 for stereo measurement, is provided in the tip portion so thateach of the optical adapters can be mounted. Although not shownparticularly, an imaging device, such as a CCD, which images an imageformed by the plurality of object lenses of the optical adapter, and alight guide that causes illumination light to be illuminated on anobject are provided inside the tip portion.

The endoscope insertion portion 3 has a long and narrow tube shape whichis flexible over a range from the tip portion to a base portion thereof.A signal line of the imaging device, a light guide body, and a wiremechanism used to operate the tip portion to be bent (all of which arenot shown) are disposed inside the endoscope insertion portion 3. In thecase when the optical adapter 2 for stereo measurement is mounted in theendoscope insertion portion 3, a pair of images with parallax(hereinafter, referred to as ‘parallax images’) are acquired by theimaging device. Then, an image signal is transmitted to the CCU 9through the signal line in the endoscope insertion portion 3.

The endoscope unit 7 is configured to include an illumination lightsource that generates illumination light guided to the light guide ofthe endoscope insertion portion 3, an electrically-operated bendingdriving unit for a wire mechanism, and an EEPROM 8 for storing a controlparameter used to drive the electrically-operated bending driving unit.The endoscope unit 7 is connected to the distal end of the endoscopeinsertion portion 3 and is built in the control unit 4.

The CCU 9 controls imaging with the imaging device provided in theendoscope insertion portion 3 and converts an image signal acquired fromthe imaging device into a video signal, such as an NTSC signal. Then,the video signal is output as an input video signal 100 (refer to FIG.3) to the control unit 4. Thus, the optical adapter 2 for stereomeasurement, the endoscope insertion portion 3, the endoscope unit 7,and the CCU 9 form an endoscope including an optical adapter for stereomeasurement and constitute a video signal acquisition portion 30 (referto FIG. 3) that acquires parallax images.

The liquid crystal monitor 6 displays an image of an object and otherinformation on the basis of a display video signal 101 a (refer to FIG.3) output from the control unit 4. The liquid crystal monitor 6constitutes a display portion 33 (refer to FIG. 3). The image andinformation are displayed independently or together as needed. In caseof performing stereo measurement like the present invention, the displayvideo signal 101 a includes one or both parallax images.

Other information includes, for example, operation input informationfrom an operation portion, such as the remote controller 5 to bedescribed later, an operation menu, and a graphical user interface (GUI)for operation (hereinafter, these operation-related information itemsare collectively referred to as an ‘operation screen image data’). Inaddition, display of a cursor image used at the time of measurement andmeasurement information 102 (refer to FIG. 3) indicating a measurementresult or the like are included.

The remote controller 5 is an operation portion for performing anoperation input of the measuring endoscope apparatus 1 and is connectedto the control unit 4. For example, ON and OFF of a power source, anoperation related to calibration setting, an operation related to animaging operation, an operation related to illumination, an operationrelated to driving for bending the endoscope insertion portion 3, anoperation related to measurement, an operation of selecting themeasurement accuracy at the time of measurement, an operation ofselecting image processing for an image displayed on the liquid crystalmonitor 6, an operation of recording image data in a storage medium orthe like, an operation of reading image data recorded in a storagemedium or the like, and the like may be mentioned as operation inputsperformed by the remote controller 5. These operation inputs may besuitably performed through a user interface.

For example, although not shown particularly, a joystick, a leverswitch, a freeze switch, a store switch, a measurement execution switch,and the like are provided in the remote controller 5. With these things,the examiner can perform various input operations by directly performingoperation and instruction inputs of the measuring endoscope apparatus 1,performing a selective input of the operation menu, or operating the GUIdisplayed on the liquid crystal monitor 6. That is, the remotecontroller 5 has a function of an operation portion 31 (refer to FIG. 3)with which an examiner performs an operation input, such as measurement.

The control unit 4 controls operations of the measuring endoscopeapparatus 1 including image processing on captured image data andcalculation processing for image measurement. In the present invention,as shown in FIG. 2, the control unit 4 is configured to include a CPU10, a ROM 11, a RAM 12, various input/output interfaces, and a videosignal processing circuit 16, as hardwares.

The CPU 10 loads a control program, which has been stored in the ROM 11or a storage medium 44 (refer to FIG. 3) to be described later, to theRAM 12, and executes the control program, thereby performing anoperation corresponding to each function to be described later. Forexample, the control unit 4 includes an RS-232C interface 15, a PC cardinterface 13, and a USB interface 14, as input/output interfaces.

The RS-232C interface 15 performs communication for making an operationcontrol between the remote controller 5, the endoscope unit 7, and theCCU 9. A PC card compliant with PCMCIA is connected to the PC cardinterface 13. In the present invention, a removable storage medium ismainly connected to the PC card interface 13, and the PC card interface13 is used to load a program for operating the apparatus and storeinformation on setting required for measurement, information on ameasurement result, or image information. For this reason, variousmemory cards using a flash memory as a storage medium, for example, aPCMCIA memory card 18 and a compact flash (registered trademark) memorycard 19 are mounted in the PC card interface 13.

A USB device is connected to the USB interface 14. In the presentinvention, a personal computer 17 is detachably connected to the USBinterface 14. In addition, when the personal computer 17 is connected tothe USB interface 4, communication is performed to transmit or receivevarious kinds of information stored in a storage medium or various kindsof information stored in a storage medium connected to the PC cardinterface 13 to or from a storage device or an internal memory of thepersonal computer 17, to play the information on a display monitor ofthe personal computer 17, or to perform various operation inputs withrespect to the control unit 4 instead of the remote controller 5.

For this reason, when the personal computer 17 is connected to the USBinterface 14, the personal computer 17 can also function as the liquidcrystal monitor 6 connected to the control unit 4, the remote controller5, and the storage medium. Accordingly, for example, a control relatedto measurement, image processing, image display, or the like can beperformed using resources of the personal computer 17 as needed. Thatis, in this case, the personal computer 17 has functions of theoperation portion 31 and display portion 33 in FIG. 3.

The video signal processing circuit 16 generates output video signals101A and 101B by performing image processing, which is designated by theremote controller 5, on the input video signal 100 (refer to FIG. 3)supplied from the CCU 9. In addition, the video signal processingcircuit 16 synthesizes the output video signals 101A and 101B with theoperation screen image data or the measurement information 102 generatedby the CPU 10, as needed, performs conversion into a signal such as anNTSC signal in order to display on the liquid crystal monitor 6, andoutputs it to the liquid crystal monitor 6 as the display video signal101 a.

Next, the stereo measurement performed by the measuring endoscopeapparatus 1 will be described. In the stereo measurement performed bythe measuring endoscope apparatus 1, at least the following first tosixth processings are performed. The first processing is processing forreading optical information from a storage medium in which optical dataof the optical adapter 2 for stereo measurement has been recorded. Thesecond processing is processing for reading positional relationshipinformation between an imaging device disposed within the tip portion ofthe endoscope insertion portion 3 and an object lens system of theoptical adapter 2 for stereo measurement.

The third processing is processing for calculating a positional error ofthe imaging device of the measuring endoscope apparatus 1 from theabove-described positional relationship information, and positionalrelationship information between an imaging device of an endoscope usedas the reference and the object lens system of the optical adapter 2 forstereo measurement, which was obtained at the time of production. Thefourth processing is processing for correcting optical data based on thepositional error. The fifth processing is processing for performingcoordinate transformation of an image to be measured on the basis of thecorrected optical data. The sixth processing is processing forcalculating three-dimensional coordinates of an arbitrary point bymatching two images on the basis of the image for which the coordinatetransformation was performed.

For example, the CPU 10 makes a control such that the first to fourthprocessings are performed once for the optical adapter 2 for stereomeasurement and the result is recorded as measuring environment data inthe storage medium. The first to fourth processings are collectivelycalled calibration processing. Thereafter, when performing the stereomeasurement, the CPU 10 makes a control such that the measuringenvironment data is loaded to the RAM 12 to perform the fifth and sixthprocessings.

Note that, when performing the second processing for reading thepositional relationship information between the imaging device in thetip portion and the object lens system of the optical adapter 2 forstereo measurement, the CPU 10 performs the second processing byacquiring the shape of a mask provided in the optical adapter 2 forstereo measurement and comparing the shape and position of the mask atthe time of production. In this case, acquisition of the mask shape isperformed by imaging an object for calibration and obtaining a whiteimage.

Next, referring to FIG. 3, a function of the control unit 4 will bedescribed focusing on each functional block relevant to the video signalprocessing circuit 16. The functional block of the control unit 4 isconfigured to include a video signal processing portion 34, a signalconversion portion 38, an image storage portion 42, an image measurementprocessing portion 43, and a control portion 45. Here, the video signalprocessing portion 34 and the signal conversion portion 38 are formed bythe video signal processing circuit 16 shown in FIG. 2.

From the video signal acquisition portion 30 configured to include theoptical adapter 2 for stereo measurement, the endoscope insertionportion 3, the endoscope unit 7, and the CCU 9, one-frame imageinformation including a pair of parallax images on which preprocessing,such as brightness level adjustment or noise removal processing, wasperformed by the CCU 9 is input to the video signal processing portion34 as the input video signal 100. The preprocessing may be performed asimage processing by the video signal processing portion 34.

The video signal processing portion 34 performs image processing on theinput video signal 100 to generate the output video signal 101A andoutputs it to the signal conversion portion 38. In addition, the videosignal processing portion 34 can generate the output video signal 101Band output it to the image storage portion 42. Note that the outputvideo signals 101A and 101B may be not only different signals but alsothe same signals on which the same image processing is performed.

The signal conversion portion 38 outputs the output video signal 101A,which was output from the video signal processing portion 34, to thedisplay portion 33 as the display video signal 101 a. In this case,other image data such as the operation screen image data may besynthesized in the display video signal 101 a, as needed. Moreover, whenthe measurement information 102 is output from the image measurementprocessing portion 43, the signal conversion portion 38 may generate thedisplay video signal 101 a in a state where the measurement information102 is also synthesized.

A measurement start/end signal 103 from the operation portion 31 is alsoinput to the video signal processing portion 34.

When receiving signals of measurement start and measurement end from theoperation portion 31, the video signal processing portion 34 outputs theinput video signal 100 from the video signal acquisition portion 30, asthe output video signal 101A, to the signal conversion portion 38.

The image storage portion 42 serves to store the output video signal101B, which is output from the video signal processing portion 34, asstill image data, and is provided on the RAM 12. Moreover, when an imagerecording signal 104 is input from the operation portion 31, the stillimage data is read from the image storage portion 42 according tocontrol of the control portion 45. Then, the still image data is outputto the storage medium 44 and is stored in the storage medium 44.

The image measurement processing portion 43 performs measurementprocessing using the still image data stored in the image storageportion 42 and generates measurement GUI image data required for ameasurement operation input. In the present invention, the imagemeasurement processing portion 43 performs stereo measurement using aknown algorithm. For example, when a measuring point is input on adisplay image of the liquid crystal monitor 6 by the operation portion31, the image measurement processing portion 43 acquires information onthe position of a corresponding point on each parallax imagecorresponding to the measuring point by matching processing based oneach brightness information item. In addition, the image measurementprocessing portion 43 calculates the three-dimensional coordinates ofthe measuring point by the principle of triangulation.

For example, measurement input information 107, which is input to theimage measurement processing portion 43 and is acquired through a GUIthat allows a positioning cursor on the liquid crystal monitor 6 tooperate by the remote controller 5 or the like, is used as theinformation of a measuring point. A measurement result of the stereomeasurement is output to the signal conversion portion 38, as themeasurement information 102, together with the measurement GUI imagedata including a measured distance, a mark of a measuring point, and thelike, is synthesized with an image of the output video signal 101A inthe signal conversion portion 38, and is displayed on the displayportion 33.

The control portion 45 is configured to include the CPU 10, the ROM 11,and the RAM 12. The control portion 45 controls an operation of eachportion by making the CPU 10 read a control program stored in the ROM 11and loading the control program to the RAM 12 and the CPU 10 execute acommand described in the control program. Note that, in FIG. 3, an arrowthat connects the control portion 45 with each portion is omitted toavoid the drawing becoming complicated.

Next, a basic operation of the measuring endoscope apparatus 1 will bedescribed. Before starting the measurement, optical characteristicinformation on the optical adapter 2 for stereo measurement, forexample, magnification information or distortion characteristicinformation on a lens, is set. This may be input by the examiner byusing the remote controller 5 or reading a condition stored in thestorage medium. This optical characteristic information is stored in theRAM 12. The examiner inserts the endoscope insertion portion 3 mountedwith the optical adapter 2 for stereo measurement into an object andmoves the endoscope insertion portion 3 toward a desired measurementposition of the object by adjusting bending of the tip portion by theremote controller 5.

An image, which is formed on the imaging device through the opticaladapter 2 for stereo measurement, is output as the input video signal100 to the control unit 4 through the CCU 9. Then, the image of theobject is displayed on the liquid crystal monitor 6. The examiner sets ameasuring position of the object while observing the image. Then, thepositioning cursor for setting the measuring point is displayed on theliquid crystal monitor 6. For example, in the case of performingdistance measurement, the examiner designates two measuring points.Then, the examiner performs an operation input which is to press ameasurement start switch from the operation portion 31 of the remotecontroller 5, for example. Then, the operation portion 31 outputs themeasurement start signal 103 to the video signal processing portion 34and the measurement input information 107 to the image measurementprocessing portion 43.

The output video signal 101A which has been subjected to imageprocessing by the video signal processing portion 34 is output to thesignal conversion portion 38. In addition, the output video signal 101Bfrom the video signal processing portion 34 is stored as still imagedata in the image storage portion 42. Here, the output video signal 101Bmay be the same video signal as the input video signal 100 or may be oneobtained by performing image processing (edge correction or the like),which does not affect the measurement accuracy, on the input videosignal 100.

When the output video signal 101B is stored in the image storage portion42, the image measurement processing portion 43 starts an imagemeasurement calculation on the basis of the measurement inputinformation 107. Then, the measurement result is output as themeasurement information 102 to the signal conversion portion 38. Thesignal conversion portion 38 generates the display video signal 101 a,which is obtained by synthesizing the measurement information 102 withthe output video signal 101A, and outputs it to the liquid crystalmonitor 6. Thus, an image of the display video signal 101 a is displayedon the liquid crystal monitor 6.

Next, a measurement operation of the measuring endoscope apparatus 1will be described while referring to flow charts and examples of adisplay screen. FIG. 4 shows the procedure of the entire operation ofthe measuring endoscope apparatus 1. When power is supplied, themeasuring endoscope apparatus 1 operates in an image display mode inwhich an image acquired through the optical adapter 2 for stereomeasurement is displayed on the liquid crystal monitor 6. Moreover, themeasuring endoscope apparatus 1 operates in various processing modescorresponding to operation inputs when an operation input occurs fromthe operation portion, such as the remote controller 5. Hereinafter,modes in which measurement processing, image information recordingprocessing, and image file play processing are performed will bedescribed as examples of various processing modes.

First, as shown in FIG. 4, in ST101, the video signal acquisitionportion 30 acquires image information corresponding to one frame. Thatis, the input video signal 100 is output from the video signalacquisition portion 30 to the video signal processing portion 34 of thecontrol unit 4, and the one-frame input video signal 100 is acquired asimage information by the video signal processing portion 34.

Then, in ST102, the video signal processing portion 34 outputs theone-frame video signal of the input video signal 100, as the outputvideo signal 101A, to the signal conversion portion 38 without anychange. The signal conversion portion 38 outputs the display videosignal 101 a, in which other image data is synthesized, to the displayportion 33. Thus, an image based on the video signal acquired by thevideo signal acquisition portion 30 is displayed on the display portion33. After ST102 ends, the process proceeds to ST103.

In ST103, the control portion 45 checks whether or not an operationinput has been performed. When the operation input has been performed,processing corresponding to the operation input is performed. Forexample, when the operation input for starting the measurement has beenperformed, the process proceeds to ST104. In addition, when an operationinput for recording image information in an image file to be describedlater has been performed, the process proceeds to ST105. In addition,when an operation input for playing the image information recorded inthe image file to be described later has been performed, the processproceeds to ST106. On the other hand, when an operation input is notperformed, the process proceeds to ST101 in which image informationcorresponding to following one frame is acquired and those describedabove are repeated.

As a result, when an operation input does not occur, an image displaymode in which an image for every one frame subjected to current imageprocessing is displayed on the display portion 33 in an approximatelyreal-time manner is realized.

FIG. 5 shows an example of a display screen in the image display mode.In the image display mode, a display screen 60 includes an I-shapeddisplay region, which includes upper, lower, and middle parts of ascreen of the display portion 33, and two display regions withapproximately rectangular shapes excluding the I-shaped display region.A parallax image 61L is displayed in the left approximately rectangularshaped display region shown in the drawing in an approximately real-timemanner, and a parallax image 61R is displayed in the approximatelyrectangular shaped right display region shown in the drawing in anapproximately real-time manner. The parallax images 61L and 61R are apair of parallax images corresponding to a pair of images acquired atthe same time through the object lenses 2B and 2A of the optical adapter2 for stereo measurement, respectively.

In the example shown in FIG. 5, an object 62 (for example, a turbineblade) having a three-dimensional shape is displayed in a lower halfportion of each parallax image. In addition to those described above,image information, text information, and the like may be appropriatelydisplayed on the display screen 60. In the present invention, a currentdate is displayed as date information 63 in a bottom region of theparallax image 61L in a real-time manner.

First Embodiment

Hereinafter, a first embodiment of the present invention will bedescribed with reference to the drawings. The present embodiment relatesto measurement processing, that is, an operation when an operation inputfor starting measurement is performed as the operation input in ST102 ofFIG. 4. First, when an operation input for starting the measurement isperformed as the operation input, that is, when the measurement startsignal 103 is input from the operation portion 31, measurementprocessing shown in FIG. 6 is performed as ST104. However, theprocessing of ST110 to ST112 is a processing for generating the outputvideo signal 101A and the processing of ST113 is a processing forgenerating the output video signal 101B, and the processing of ST110 toST112 and the processing of ST113 are executed simultaneously and inparallel through two systems.

In ST110, the video signal processing portion 34 performs processing fordividing an image of the input video signal 100 from the video signalacquisition portion 30 into two images of the parallax images 61L and61R of FIG. 5. That is, the video signal processing portion divides theacquired image information for every parallax image.

Then, in ST111, the video signal processing portion 34 performsprocessing for enlarging one parallax image (parallax image 61L) of thetwo parallax images divided in ST110. A video signal based on a parallaximage 61La after enlarging processing is output as the output videosignal 101A to the signal conversion portion 38. In the presentembodiment, the video signal processing portion 34 performs enlargingprocessing on the entire parallax image 61L to set it as the parallaximage 61La such that the length of the parallax image 61La afterenlarging processing in the longitudinal direction is approximatelyequal to the length of the screen of the display portion 33 in thelongitudinal direction.

Then, in ST112, the signal conversion portion 38 superimposes themeasurement information 102, which is generated in the image measurementprocessing portion 43, on the output video signal 101A based on theparallax image 61La after enlarging processing and outputs it to thedisplay portion 33 as the display video signal 101 a. The displayportion 33 displays the parallax image 61La after enlarging processingon the basis of the display video signal 101 a. The visibility for theexaminer can be raised by displaying one of the two parallax images 61Land 61R. In addition, the visibility can be further improved byenlarging the one parallax image and displaying it. Although theparallax image 61L is used in this example, the other parallax image 61Rmay alternatively be used.

ST113 is processed in parallel with the above-described ST110 to ST112.In ST113, the output video signal 101B is output from the video signalprocessing portion 34 to the image storage portion 42 and is temporarilystored in the image storage portion 42. The output video signal 101B isa video signal based on image data including both the parallax images61L and 61R, similar to the input video signal 100. In the presentembodiment, the stereo measurement processing performed by the imagemeasurement processing portion 43 calculates the three-dimensionalcoordinates of a measuring point by the principle of triangulation.Accordingly, a measurement video signal 101 b having both the left andright parallax images is temporarily stored in the image storage portion42 separately from the display video signal 101 a.

FIG. 7 shows an example of a display screen 60A at the start of ameasurement mode. In addition to the parallax image 61La after enlargingprocessing and the date information 63, measurement conditioninformation 64 corresponding to the measurement GUI image data, anoperation icon 65, a measurement cursor 66, message information 67,image matching degree information 68, and the like are displayed on thedisplay screen 60A.

The display screen 60A is configured to include two approximatelyrectangular display regions disposed on the left and right sides. Theleft display region of the two display regions is similar to the displayregion of the display screen 60 shown in FIG. 5 where the parallax image61L is displayed. However, the left display region is formed so as toenlarge the display region of the display screen 60 shown in FIG. 5where the parallax image 61L is displayed such that the length thereofin the longitudinal direction is approximately equal to the length ofthe display portion 33 in the longitudinal direction. The parallax image61La after enlarging processing is displayed in the left display regionof the display screen 60A. The date information 63, the measurementcondition information 64, the operation icon 65, the message information67, the image matching degree information 68, and the like are displayedin the right display region of the display screen 60A. The measurementcursor 66 is displayed so as to overlap the parallax image 61La afterenlarging processing.

Thus, in the present embodiment, the entire parallax image 61L issubjected to enlarging processing up to a region, in which the parallaximages 61L and R were not displayed in the display screen 60 shown inFIG. 5, and is displayed as the parallax image 61La.

The measurement condition information 64 shows information on a currentmeasurement condition. In the present embodiment, the type of theoptical adapter 2 for stereo measurement being used is displayed as anexample. As an example, the operation icon 65 includes: a measurementswitching icon 65 a for setting types of measurement operations to beperformed, for example, a distance (‘between two points’), a depth, anarea, and an angle; a mode switching icon 65 b for changes of varioussettings, such as a change of the shape or color of the measurementcursor 66; a clear icon 65 c for clearing a measuring point, anexecution result of measurement, and the like; a termination icon 65 dfor terminating measurement processing; and a display switching icon 65e for inputting an instruction for changing the display form of thedisplay screen 60A to be described later.

The measurement cursor 66 is for inputting a measuring point on thedisplay screen 60A in response to an operation input from the operationportion 31 or performs an operation such as selection of an icon ormenu. The message information 67 displays information on the operationor measurement as various kinds of text information or numericalinformation. For example, in FIG. 7, operation guidance (example: PUTM1=input of a first measuring point) is displayed.

The image matching degree information 68 indicates the degree(hereinafter, referred to as matching degree) of matching between adesignated position of one parallax image (in this example, the parallaximage 61L) input by the examiner and the corresponding position ofanother parallax image (in this example, the parallax image 61R). Thismatching degree is calculated by the image measurement processingportion 43. The matching degree is expressed by six square indicators,and a smaller number of square indicators are displayed as the matchingdegree becomes stronger (as images at the designated position furthermatch each other).

Moreover, object distance information may be displayed instead of theimage matching degree information 68.

The object distance information shows the degree of the distance betweenthe tip portion of the endoscope insertion portion 3 and the object 62.This object distance is calculated by the image measurement processingportion 43. The object distance is expressed by six square indicators,and a smaller number of square indicators are displayed as the objectdistance becomes smaller.

In addition, although the matching degree information or the objectdistance information is expressed by the square indicators in thisexample, they may be expressed by numeric values or in other forms.

As shown in FIG. 6, after the above-described ST112 and ST113 end, theprocess proceeds to ST114.

In ST114, a message that requests a measuring point input is displayedas the message information 67 of FIG. 7, and the measuring point inputis received. The examiner inputs a measuring point by moving themeasurement cursor 66 and selecting a position on the screen with theoperation portion 31 while observing the display screen 60A of thedisplay portion 33. In addition, whenever the position is selected,coordinate information on the parallax image 61L (parallax image 61Laafter enlarging processing) is acquired and, for example, X-shapedselected position display FIGS. 69 a and 69 b are displayed so as tooverlap the parallax image 61La after enlarging processing, as shown inFIG. 8. For example, in the case of distance measurement, ST114 endswhen the examiner designates two positions as described above, and theprocess proceeds to ST115.

In ST115, the image measurement processing portion 43 reads the outputvideo signal 101B, which is temporarily stored in the image storageportion 42 in ST113, from the image storage portion 42. Then, the imagemeasurement processing portion 43 calculates a corresponding position onthe parallax image 61R, which corresponds to the measuring position onthe parallax image 61L input in ST114, by image matching processing onthe basis of the still image data based on the read output video signal101B.

In ST116, the image measurement processing portion 43 performsmeasurement processing using the parallax of two images on the basis ofthe measuring position on the parallax image 61L input in ST114 and thecorresponding position on the parallax image 61R corresponding to themeasuring position on the parallax image 61L calculated in ST115.

Then, in ST117, the image measurement processing portion 43 outputs aresult of the measurement processing performed in ST116, as themeasurement information 102, to the signal conversion portion 38. Thesignal conversion portion 38 superimposes the measurement information102, which was generated in the image measurement processing portion 43,on the output video signal 101A from the video signal processing portion34 and outputs it to the display portion 33 as the display video signal101 a. The display portion 33 displays the parallax image 61La afterenlarging processing on the basis of the display video signal 101 a. Asa result, measurement result information 70 is displayed as shown inFIG. 8. As an example, in FIG. 8, a measurement distance L between twopoints (69 a, 69 b) is displayed as ‘L=2.34 mm’.

Then, in ST118, the control portion 45 checks whether or not anoperation for terminating the measurement has been performed in theoperation portion 31. When the operation for terminating the measurementhas not been performed, the process proceeds to ST114. In addition, whenthe operation for terminating the measurement is performed, themeasurement processing ends and the process proceeds to ST101 of FIG. 4.Then, the operation of the measuring endoscope apparatus 1 moves to theimage display mode and an operation of acquiring image information of anext frame is performed.

As described above, in ST115 of FIG. 6, the matching degree of imagebetween the position that the examiner designated on one parallax image(in this example, the parallax image 61L) and the position on the otherparallax image (in this example, the parallax image 61R) is calculated,and the calculation result is displayed in ST117. At this time, thedisplay screen 60A of FIG. 7, on which only the parallax image 61Laafter enlarging processing is displayed, and the display screen (displayscreen similar to the known display screen 140 shown in FIG. 29), onwhich both the parallax images 61L and 61R are displayed, may beswitched to be displayed.

For example, when the examiner sees the image matching degreeinformation 68 of FIG. 7 and selects the display switching icon 65 e,the control portion 45 recognizes that a display screen switchinginstruction is input and executes processing for switching of a displayscreen. The video signal processing portion 34 outputs a video signalbased on image data including both the parallax images 61L and 61R, asthe output video signal 101A, to the signal conversion portion 38 on thebasis of the instruction from the control portion 45. As a result, thescreen returns to the display screen on which both the parallax images61L and 61R are displayed. Then, the examiner can visually check whetheror not the designated points on the parallax images 61L and 61R match.

Moreover, when the matching degree is low, a display screen on whichboth the parallax images 61L and 61R are displayed may be automaticallydisplayed so that the examiner visually checks whether or not thedesignated points on the parallax images 61L and 61R match. In thiscase, the control portion 45 determines whether or not the matchingdegree is low by comparing the matching degree calculated by the imagemeasurement processing portion 43 with a threshold value. The controlportion 45 determines whether to switch the display screen according tothe determination result. The threshold value used for comparison withthe matching degree may be a fixed value or may be set by the examiner.When the matching degree is low, the control portion 45 executesprocessing for switching of a display screen. The video signalprocessing portion 34 outputs a video signal based on the image dataincluding both the parallax images 61L and 61R, as the output videosignal 101A, to the signal conversion portion 38 on the basis of theinstruction from the control portion 45.

Moreover, as shown in FIG. 9, in order to make the examiner visuallycheck on the display screen 60A whether or not the designated pointsmatch between the parallax images, the control portion 45 may performdisplay by overlapping a peripheral image 80 obtained by extracting theperiphery of the parallax image 61R at a position that the examinerdesignated on the parallax image 61L (parallax image 61La). Furthermore,although the peripheral image 80 is displayed on the parallax image 61Laafter enlarging processing so as to overlap the parallax image 61La inFIG. 9, the parallax image 61La after enlarging processing may bedisplayed on the peripheral image 80 so as to overlap the peripheralimage 80. Furthermore, the display screen 60A shown in FIG. 7 and thedisplay screen 60A shown in FIG. 9 may be switched according to anoperation of the display switching icon 65 e.

In addition, when the matching degree regarding input measuring point issmaller than a predetermined threshold value, the control portion 45 mayautomatically display both the parallax images 61L and 61R on thedisplay screen of the display portion 33 so as to enable the examiner tomodify the measuring point. In this case, as shown in FIG. 10, ST120 toST124 are added between ST115 and ST116 of FIG. 6.

In ST120, the control portion 45 compares the matching degree calculatedby the image measurement processing portion 43 with a threshold valueand checks whether or not the matching degree is equal to or more thanthe predetermined threshold value. When the matching degree is equal toor more than the predetermined threshold value, the process proceeds toST116. When the matching degree is smaller than the predeterminedthreshold value, a message indicating that there was an error in theimage matching processing is displayed on the message information 67 asshown in FIG. 11, and proceeds to ST121.

In ST121, the control portion 45 executes processing for switching of adisplay screen. The video signal processing portion 34 outputs a videosignal based on the image data including both the parallax images 61Land 61R which are temporarily stored in the image storage portion 42 inST113, as the output video signal 101A, to the signal conversion portion38 on the basis of the instruction from the control portion 45. As aresult, as shown in FIG. 12, both the parallax images 61L and 61R aredisplayed on the display screen of the display portion 33.

In ST122, the examiner modifies the measuring point by moving themeasurement cursor 66 and selecting a position on the screen with theoperation portion 31 while observing the display screen on which boththe parallax images 61L and 61R are displayed. Corresponding to themodified position, coordinate information on the parallax images 61L and61R are acquired again.

In ST123, the control portion 45 executes processing for switching of adisplay screen. The video signal processing portion 34 outputs a videosignal based on the parallax image 61La after enlarging processing, asthe output video signal 101A, to the signal conversion portion 38 on thebasis of the instruction from the control portion 45. The signalconversion portion 38 superimposes the measurement information 102 aftermodification on the output video signal 101A and outputs it to thedisplay portion 33 as the display video signal 101 a. As a result, asshown in FIG. 13, the parallax image 61La after enlarging processing isdisplayed again on the display portion 33.

Thus, the measuring point is modified such that the matching degreeregarding the measuring point becomes equal to or more than thepredetermined threshold value, and the process proceeds to ST124.

In ST124, the control portion 45 checks whether or not an operation forterminating the input of a measuring point in the operation portion 31has been performed. When the operation for terminating the input ofmeasurement has not been performed, the process proceeds to ST114. Inaddition, when the operation for terminating the input of a measuringpoint has been performed, the process proceeds to ST116 in whichmeasurement processing is performed.

That is, ST120 to ST123 are repeated according to the number ofmeasuring points required for measurement.

In addition, when it is determined that the matching degree is smallerthan the predetermined threshold value in ST120, the measuring pointinput in ST114 may be cleared and a measuring point may be input againin ST122.

According to the present embodiment, when the measurement start signal103 is input from the operation portion 31 during a period (periodincluding at least a part until a point of time at which a measurementresult is generated by performing measurement from a point of time atwhich measurement processing starts) regarding measurement, the parallaximage 61La which is subjected to enlarging processing is displayed. Theexaminer performs an operation, such as input of a measuring point,while observing the display screen on which the parallax image 61Laafter enlarging processing is displayed. Accordingly, since thevisibility of a display image can be improved, it can be expected thatthe examiner would not be confused about performing an operation, suchas input of a measuring point, on which parallax image.

Moreover, the visibility can be further improved by enlarging oneparallax image and displaying it.

FIGS. 14 and 15 show an example where the timing at which one of the twoparallax images 61L and 61R are enlarged and displayed is changed.

In ST102 of FIG. 4, a video signal of the one-frame input video signal100 acquired in S101 is output as the output video signal 101A to thesignal conversion portion 38 without any change. That is, when theoperation input does not occur, image data including both the parallaximages 61L and 61R is displayed on the display portion 33.

However, as shown in FIG. 14, in this modified example, processing ofST130 to ST133 is performed instead of processing of ST102 of FIG. 4when image information corresponding to one frame is acquired in ST101.In these ST130 to ST133, the same processing as ST110 to ST113 of FIG. 6is performed. That is, in this modified example, an image of theone-frame input video signal 100 acquired in S101 is divided into thetwo parallax images 61L and 61R (ST130), enlarging processing isperformed on one parallax image 61L (ST131), and one parallax image 61Laafter enlarging processing is displayed on the display portion 33(ST132).

Thus, the video signal processing portion 34 may output the parallaximage 61La as the output video signal 101A in the image display mode(when a video signal of a subject is displayed in a real-time manner).

At this time, the parallax image 61La is continuously displayed as theoutput video signal 101A in the measurement mode even if the processproceeds from the image display mode to the measurement mode. That is,in ST103 of FIG. 14, when an operation input for starting themeasurement is performed, the process proceeds to ST104. In themeasurement processing in this modified example, processing of ST114 toS118 is performed as shown in FIG. 15. In the image display mode, sinceprocessing for displaying one parallax image 61La after enlargingprocessing has already been performed, the processing equivalent toST110 to ST113 of FIG. 6 is omitted.

Second Embodiment

Hereinafter, a second embodiment of the present invention will bedescribed with reference to the drawings. Enlarging processing of aparallax image in the second embodiment is different from that in thefirst embodiment. Although enlarging processing of the entire parallaximage 61L is performed automatically in the first embodiment, enlargingprocessing of a region of the parallax image 61L designated by theexaminer is performed in the second embodiment.

As shown in FIG. 16, in ST200, the video signal processing portion 34divides acquired image information for every parallax image byperforming processing for dividing an image of the input video signal100 from the video signal acquisition portion 30 into two parallaximages 61L and 61R of FIG. 5. Of the two divided parallax images, avideo signal based on one parallax image (parallax image 61L) is outputas the output video signal 101A to the signal conversion portion 38.

Then, in ST201, the signal conversion portion 38 superimposes themeasurement information 102, which is generated in the image measurementprocessing portion 43, on the output video signal 101A based on theparallax image 61L and outputs it to the display portion 33 as thedisplay video signal 101 a. The display portion 33 displays the parallaximage 61L on the basis of the display video signal 101 a.

ST113 is processed in parallel with the above-described ST200 and ST201.Processing of ST113 is the same as that in the first embodiment.

FIG. 17 shows a display screen 60B at the start of such measurementmode. The parallax image 61L, the date information 63, the measurementcondition information 64, the operation icon 65, the message information67, an enlargement cursor 72, and the like are displayed on the displayscreen 60B.

The display screen 60B is configured to include a display region, whichis disposed approximately in the middle of the display screen 60B andhas the same size as the display region where the parallax image 61L isdisplayed on the display screen 60 shown in FIG. 5, and a frame-shapeddisplay region surrounding the display region.

The parallax image 61L is displayed in the approximately middle displayregion of the display screen 60B. In addition, the date information 63,the measurement condition information 64, the operation icon 65, themessage information 67, and the like are displayed in upper and lowerportions of the frame-shaped display region.

The enlargement cursor 72 serves to designate an enlarged region on thedisplay screen 60B in response to an operation input from the operationportion 31. The enlargement cursor 72 is displayed so as to overlap theparallax image 61L.

As shown in FIG. 16, after the above-described ST200 and ST201 end, theprocess proceeds to ST202. In ST202, a region to be enlarged on theparallax image 61L is designated. First, as shown in FIG. 17, a messagethat requests designation of an enlarged region is displayed as themessage information 67, and the control portion 45 receives the input ofan enlarged region. The examiner inputs an enlarged region by moving theenlargement cursor 72 and selecting two arbitrary points 73 a and 73 bon the screen with the operation portion 31 while observing the displayscreen 60B of the display portion 33 on which the parallax image 61L isdisplayed. A rectangle having a line segment, which connects theselected two points 73 a and 73 b, as a diagonal line is designated asthe enlarged region. Information on the designated enlarged region isoutput to the video signal processing portion 34.

As shown in FIG. 18, in ST202, the examiner may input an enlarged regionby moving the enlargement cursor 72 and selecting one arbitrary point 73c on the screen with the operation portion 31 while observing thedisplay screen 60B of the display portion 33 on which the parallax image61L is displayed. In this case, a predetermined region having theselected one point 73 c as the center is designated as the enlargedregion.

In ST203, the video signal processing portion 34 performs enlargingprocessing on the parallax image 61L on the basis of the information onthe enlarged region in ST202. A video signal based on the parallax image61La after enlarging processing is output as the output video signal101A to the signal conversion portion 38. The signal conversion portion38 superimposes the measurement information 102, which is generated inthe image measurement processing portion 43, on the output video signal101A based on the parallax image 61La after enlarging processing, andoutputs it to the display portion 33 as the display video signal 101 a.The display portion 33 displays the parallax image 61La after enlargingprocessing, instead of the parallax image 61L, on the basis of thedisplay video signal 101 a.

FIG. 19 shows a display screen 60C after enlarging processing in suchST202 and ST203. The parallax image 61La after enlarging processing, thedate information 63, the measurement condition information 64, theoperation icon 65, the measurement cursor 66, the message information67, the image matching degree information 68, and the like are displayedon the display screen 60C.

Similar to the display screen 60B of FIG. 17, the display screen 60C isconfigured to include a display region, which is disposed approximatelyin the middle of the display screen 60C and has the same size as thedisplay region where the parallax image 61L is displayed on the displayscreen 60 shown in FIG. 5, and a frame-shaped display region surroundingthe display region.

The parallax image 61La after enlarging processing is displayed in theapproximately middle display region of the display screen 60C. Inaddition, the date information 63, the measurement condition information64, the operation icon 65, the message information 67, the imagematching degree information 68, and the like are displayed in upper andlower portions of the frame-shaped display region. The measurementcursor 66 is displayed so as to overlap the parallax image 61La afterenlarging processing.

As shown in FIG. 20, the signal conversion portion 38 may change thedisplay form (display position of a menu and the like) before and afterenlargement, such that a display screen 60D after enlarging processingis configured to include two approximately rectangular display regionsdisposed on the left and right sides similar to the display screen 60Ashown in FIG. 7. In this case, the parallax image 61La after enlargingprocessing is displayed in the left display region of the display screen60D. The date information 63, the measurement condition information 64,the operation icon 65, the message information 67, the image matchingdegree information 68, and the like are displayed in the right displayregion of the display screen 60D. The measurement cursor 66 is displayedso as to overlap the parallax image 61La after enlarging processing.

After the above-described ST203 ends, the process proceeds to ST114.Processing of ST114 to ST118 is the same as that in the firstembodiment.

According to the present embodiment, when the examiner designates anenlarged region during a period (period including at least a part untila point of time at which a measurement result is generated by performingmeasurement from a point of time at which measurement processing starts)regarding measurement, a region of the parallax image 61L designated bythe examiner is subjected to enlarging processing and is displayed asthe parallax image 61La. The examiner performs an operation, such asinput of a measuring point, while observing the display screen on whichthe parallax image 61La after enlarging processing is displayed.Therefore, also in the present embodiment, the same effect as in thefirst embodiment can be obtained. In addition, according to presentembodiment, since the examiner can arbitrarily designate an enlargedregion of the parallax image 61L, the visibility can be furtherimproved.

The enlargement cursor 72 may be displayed to have a shape, a color, andthe like different from the measurement cursor 66. Moreover, the imagematching degree information 68 may not be displayed at the time ofdesignation of an enlarged region.

Modified Example of the Second Embodiment

Hereinafter, a modified example of the second embodiment of the presentinvention will be described with reference to the drawings.

As shown in FIG. 21, in ST210, the video signal processing portion 34outputs the input video signal 100 from the video signal acquisitionportion 30, as the output video signal 101A, to the signal conversionportion 38 without any change. That is, in this modified example, avideo signal based on the parallax images 61L and 61R is output as theoutput video signal 101A to the signal conversion portion 38. Then, thesignal conversion portion 38 superimposes the measurement information102, which is generated in the image measurement processing portion 43,on the output video signal 101A based on the parallax images 61L and 61Rand outputs it to the display portion 33 as the display video signal 101a. The display portion 33 displays the parallax images 61L and 61R onthe basis of the display video signal 101 a.

FIG. 22 shows a display screen 60E at the start of such measurementmode. The parallax images 61L and 61R, the date information 63, themeasurement condition information 64, the operation icon 65, the messageinformation 67, the enlargement cursor 72, and the like are displayed onthe display screen 60E. The parallax images 61L and 61R, the dateinformation 63, the measurement condition information 64, the operationicon 65, the message information 67, and the like are displayed in thesame manner as the display image 60 of FIG. 5. The enlargement cursor 72is displayed so as to overlap the parallax image 61L.

In ST211, a region to be enlarged is designated on the parallax image61L. First, as shown in FIG. 22, a message that requests designation ofan enlarged region is displayed as the message information 67, and thecontrol portion 45 receives the input of an enlarged region. Theexaminer inputs an enlarged region by moving the enlargement cursor 72and selecting two arbitrary points 73 a and 73 b on the screen with theoperation portion 31 while observing the display screen 60E of thedisplay portion 33 on which the parallax image 61L is displayed. Arectangle having a line segment, which connects the selected two points73 a and 73 b, as a diagonal line is designated as the enlarged region.Information on the designated enlarged region is output to the videosignal processing portion 34.

Then, in ST212, the video signal processing portion 34 divides acquiredimage information for every parallax image by performing processing fordividing an image of the input video signal 100 from the video signalacquisition portion 30 into two parallax images 61L and 61R of FIG. 5.

Then, in ST213, the video signal processing portion 34 performsprocessing for enlarging one parallax image (parallax image 61L) of thetwo parallax images divided in ST212 on the basis of the information onthe enlarged region in ST211. A video signal based on the parallax image61La after enlarging processing is output as the output video signal101A to the signal conversion portion 38. The signal conversion portion38 superimposes the measurement information 102, which is generated inthe image measurement processing portion 43, on the output video signal101A based on the parallax image 61La after enlarging processing andoutputs it to the display portion 33 as the display video signal 101 a.The display portion 33 displays the parallax image 61La after enlargingprocessing, instead of the parallax images 61L and 61R, on the basis ofthe display video signal 101 a.

FIG. 23 shows a display screen 60F after enlarging processing in suchST211 to ST213. The parallax image 61La after enlarging processing, thedate information 63, the measurement condition information 64, theoperation icon 65, the measurement cursor 66, the message information67, and the like are displayed on the display screen 60F.

For example, similar to the display screen 60B of FIG. 17, the displayscreen 60F is configured to include a display region, which is disposedapproximately in the middle of the display screen 60F and has the samesize as the display region where the parallax image 61L is displayed onthe display screen 60 shown in FIG. 5, and a frame-shaped display regionsurrounding the display region.

The parallax image 61La after enlarging processing is displayed in theapproximately middle display region of the display screen 60F. Inaddition, the date information 63, the measurement condition information64, the operation icon 65, the message information 67, and the like aredisplayed in upper and lower portions of the frame-shaped displayregion. The measurement cursor 66 is displayed so as to overlap theparallax image 61La after enlarging processing.

After the above-described ST213 ends, the process proceeds to ST114.Processing of ST114 to ST118 is the same as that in the secondembodiment.

As described above, also in the modified example of the secondembodiment, the same effect as in the second embodiment can be obtained.

Moreover, in ST213, as shown in FIG. 24, a video signal based on theparallax image 61La may be output as the output video signal 101A to thesignal conversion portion 38 together with the input video signal 100.The signal conversion portion 38 superimposes the measurementinformation 102, which is generated in the image measurement processingportion 43, on the output video signal 101A from the video signalprocessing portion 34 and outputs it to the display portion 33 as thedisplay video signal 101 a. In this case, the display portion 33displays the enlarged parallax image 61La together with the parallaximages 61L and 61R on the basis of the display video signal 101 a.

In this case, since the parallax images 61L and 61R and the parallaximage 61La which is superimposed on the parallax images 61L and 61R aredisplayed on the same display screen, it can be expected that theexaminer will pay attention to the enlarged parallax image 61La whileseeing the entire of the parallax images.

Third Embodiment

Hereinafter, a third embodiment of the present invention will bedescribed with reference to the drawings. The present embodiment relatesto storage processing of image information and play processing of animage file, that is, an operation when an operation input for recordingimage information or an operation input for playing an image file isperformed as the operation input in ST102 of FIG. 4.

First, an operation when an operation input for recording imageinformation is performed as the operation input in ST102 of FIG. 4 willbe described. When the image recording signal 104 is input from theoperation portion 31, recording processing shown in FIG. 25 is performedas ST105. Even during the execution of ST104 in FIG. 4, it is possibleto receive the recording processing of ST105 by the operation input andto execute it.

In ST300, the video signal processing portion 34 outputs the input videosignal 100 from the video signal acquisition portion 30, as the outputvideo signal 101B, to the image storage portion 42 without any change.That is, a video signal corresponding to the parallax images 61L and 61Ris temporarily stored in the image storage portion 42.

In ST301, the video signal that is temporarily stored in the imagestorage portion 42 in ST300 is read from the image storage portion 42according to the control of the control portion 45. In ST302, the videosignal read from the image storage portion 42 in ST301 is recorded as animage file in the storage medium 44, such as the PCMCIA memory card 18or the compact flash (registered trademark) memory card 19 connected tothe PC card interface 13. At this time, the video signal may be recordeddistinctively as a separate image file.

Next, an operation when an operation input for playing an image file isperformed as the operation input in ST102 of FIG. 4 will be described.When an operation input for playing the image file is performed, playprocessing shown in FIG. 26 is performed as ST106. In FIG. 4, the playprocessing of ST106 cannot be executed in parallel with the measurementprocessing of ST104 or the recording processing of ST105. When anoperation input for play processing is performed during processing ofthe measurement processing or the recording processing, the controlportion 45 stops these processings and executes the play processing.

In ST310, for example, a selection menu, such as an image file list, isdisplayed on the display screen 60. The examiner selects an image file(image information) to be played using the remote controller 5 and thelike. The selected video signal is read from the storage medium 44according to the control of the control portion 45. This video signal isthe same as the output video signal 101B stored in the storage medium 44in step ST302 of FIG. 21. In ST311, the video signal read from thestorage medium 44 is temporarily stored in the image storage portion 42.

In ST312, the video signal temporarily stored in the image storageportion 42 is output to the video signal processing portion 34. Thevideo signal processing portion 34 divides acquired image informationfor every parallax image by performing processing for dividing an imageof the video signal from the image storage portion 42 into two parallaximages 61L and 61R.

In ST313, similar to ST111, the video signal processing portion 34performs processing for enlarging one parallax image (parallax image61L) of the two parallax images divided in ST312. A video signal basedon the parallax image 61La after enlarging processing is output as theoutput video signal 101A to the signal conversion portion 38.

In ST314, the signal conversion portion 38 superimposes the measurementinformation 102, which is generated in the image measurement processingportion 43, on the output video signal 101A based on the parallax image61La after enlarging processing and outputs it to the display portion 33as the display video signal 101 a. A display screen at this time is thesame as the display screen 60A of FIG. 7 except that the display screenis not real-time display but still image display unlike the imagedisplay mode. In this case, for example, modifications for displayingthe date at the time of recording as the date information 63 ordisplaying text information for identifying an image file or an iconindicating the image play mode on the display screen 60 so as to overlapthe display screen 60 may be suitably performed.

In ST315, the control portion 45 checks whether or not an operationinput for terminating play of an image file has been performed in theoperation portion 31. When the operation input for terminating play ofthe image file has been performed, the play processing ends and theprocess proceeds to ST101 of FIG. 4. Thus, for example, when it is onlyan object to see an image of an object, which was recorded in the past,on the display portion 33, the examiner can perform an operation inputfor terminating play of the image file after observing the image of theobject and then return to the image display mode. When an operationinput for terminating play of an image file in ST315 has not beenperformed, the process proceeds to ST316.

In ST316, the control portion 45 checks whether or not an operationinput for starting measurement has been performed in the operationportion 31. When the operation input for starting the measurement isperformed, the process proceeds to ST317. When the operation input forstarting the measurement has not been performed, the process proceeds toST315.

ST317 to ST322 show measurement processing in which image measurement isperformed using the video signal stored in the image storage portion 42.Hereinafter, an explanation will be made focusing on a different pointfrom the measurement processing of ST110 to ST118 of FIG. 6.

In ST317, the video signal temporarily stored in the image storageportion 42 in ST311 is read and is output to the video signal processingportion 34 according to the control of the control portion 45.

In ST318, the same processing as ST114 of FIG. 6 is performed. In ST319to ST321, the same processing as ST115 to ST117 of FIG. 6 is performed.That is, in ST320, the image measurement processing portion 43 performsmeasurement processing using still image data based on the video signalread in ST310. Moreover, in ST321, the signal conversion portion 38superimposes the measurement information 102, which is generated in theimage measurement processing portion 43, on the output video signal 101Abased on the parallax image 61L from the video signal processing portion34 and outputs it to the display portion 33 as the display video signal101 a. The display portion 33 displays the parallax image 61L on thebasis of the display video signal 101 a. In ST322, the same processingas ST118 of FIG. 6 is performed.

Fourth Embodiment

Hereinafter, a fourth embodiment of the present invention will bedescribed with reference to the drawings. Similar to the thirdembodiment, the present embodiment relates to storage processing ofimage information and play processing of an image file, that is, anoperation when an operation input for recording image information or anoperation input for playing an image file is performed as the operationinput in ST102 of FIG. 4. In the present embodiment, a display image anda measurement image are recorded separately from each other.

First, an operation when an operation input for recording imageinformation is performed as the operation input in ST102 of FIG. 4 willbe described. When the image recording signal 104 is input from theoperation portion 31, recording processing shown in ST400 to ST407 inFIG. 27 is performed as ST105. Even during the execution of ST104 inFIG. 4, the control portion 45 can receive the recording processing ofST105 by the operation input and execute it.

In ST400, the control portion 45 checks whether or not measurementprocessing is being performed. If the measurement processing is beingperformed, the process proceeds to ST401 and ST405. If the measurementprocessing is not being performed, the process proceeds to ST405.

An operation when it is checked that the measurement processing is beingperformed in ST400 is as follows.

Processing of ST401 to ST404 is processing regarding recording of adisplay image and processing of ST405 to ST407 is processing regardingrecording of a measurement image or a display image, and the processingof ST401 to ST404 and the processing of ST405 to ST407 are executedsimultaneously and in parallel through two systems. In ST401, the videosignal processing portion 34 divides acquired image information forevery parallax image by performing processing for dividing an image ofthe input video signal 100 from the video signal acquisition portion 30into two parallax images 61L and 61R of FIG. 6. A video signal based onone (in this example, the parallax image 61L) of the two dividedparallax images is output as the output video signal 101B to the imagestorage portion 42.

In ST402, a video signal corresponding to the parallax image 61L dividedin ST401 is stored in the image storage portion 42. When division ofimage information has been already performed in ST104 of FIG. 4, thevideo signal which is obtained as the processing result is used insubsequent processing.

In ST403, the video signal, which is temporarily stored in the imagestorage portion 42 in ST402, is read from the image storage portion 42according to the control of the control portion 45. In ST404, the videosignal read from the image storage portion 42 in ST403 is recorded as animage file in the storage medium 44, such as the PCMCIA memory card 18or the compact flash (registered trademark) memory card 19 connected tothe PC card interface 13. At this time, the video signal may be recordeddistinctively as a separate image file.

On the other hand, in ST405, the output video signal 101B based on imagedata including both the parallax images 61L and 61R is output from thevideo signal processing portion 34 to the image storage portion 42, andthe image information is temporarily stored in the image storage portion42. When storage of the video signal has been already performed in themeasurement processing ST104, the video signal is used in subsequentprocessing.

In ST406, the video signal, which is temporarily stored in the imagestorage portion 42 in ST405, is read according to the control of thecontrol portion 45. Then, in ST407, the video signal read from the imagestorage portion 42 in ST406 is recorded as an image file in the storagemedium 44, such as the PCMCIA memory card 18 or the compact flash(registered trademark) memory card 19 connected to the PC card interface13. At this time, the video signal may be recorded distinctively as aseparate image file.

Moreover, in ST400, when it is checked that the measurement processingis not being performed, processing (ST405 to ST407) regarding recordingof a display image is performed.

Next, an operation when an operation input for playing an image file isperformed as the operation input in ST102 of FIG. 4 will be described.When an operation input for playing an image file is performed, playprocessing shown in ST410 to ST424 in FIG. 28 is performed as ST106. InFIG. 4, the play processing of ST106 cannot be executed in parallel withthe measurement processing of ST104 or the recording processing ofST105. When an operation input of play processing is performed duringprocessing of the measurement processing or the recording processing,these processings are stopped to execute the play processing.

In ST410, for example, a selection menu, such as an image file list, isdisplayed on the display screen 60. A video signal that the examinerselected as an image file (display image information), which is to beplayed, using the remote controller 5 is read from the storage medium 44according to the control of the control portion 45. This video signal isthe same as the output video signal 101A at the time of recording and isstored in the storage medium 44 as a measurement video signal or adisplay video signal in step ST407 of FIG. 27. In ST411, the videosignal read from the storage medium 44 is temporarily stored as thedisplay video signal in the image storage portion 42.

In ST412, the display video signal stored in the image storage portion42 in ST411 is output from the image storage portion 42 to the signalconversion portion 38, the display video signal 101 a is output from thesignal conversion portion 38 to the display portion 33, and an image isdisplayed on the display portion 33. A display screen at this time isthe same as the display screen 60 of FIG. 5 except that the displayscreen is not real-time display in the image display mode but stillimage display. Moreover, the video signal stored in the storage medium44 in step ST404 of FIG. 27 may be used as the display video signal. Inthis case, one parallax image 61L of the two parallax images 61L and 61Ris displayed.

In ST413, the control portion 45 checks whether or not an operationinput for terminating play of an image file has been performed in theoperation portion 31. When the operation input for terminating play ofthe image file is performed, the play processing ends and the processproceeds to ST101 of FIG. 4. When an operation input for terminatingplay of an image file has not been performed in ST413, the processproceeds to ST414.

In ST414, the control portion 45 checks whether or not an operationinput for starting measurement has been performed in the operationportion 31. When the operation input for starting the measurement isperformed, the process proceeds to ST415. When the operation input forstarting the measurement has not been performed, the process proceeds toST413.

ST415 to ST424 show measurement processing in which image measurement isperformed using the video signal stored in the image storage portion 42in ST411. Hereinafter, an explanation will be made focusing on adifferent point from the measurement processing of ST110 to ST118 ofFIG. 6.

In ST415, the video signal temporarily stored in the image storageportion 42 in ST411 is read as a display video signal and is output tothe video signal processing portion 34 according to the control of thecontrol portion 45. However, the measurement processing cannot beperformed only with one parallax image of the two parallax images.Accordingly, in the case where the video signal temporarily stored inthe image storage portion 42 is image data stored in the storage medium44 in ST404 of FIG. 23, the measurement processing is not performed andthe process proceeds to ST413 (not shown).

In ST416, the video signal processing portion 34 performs processing fordividing an image of the display video signal read from the imagestorage portion 42 into two parallax images and a video signal based onone parallax image (in this example, the parallax image 61L of FIG. 7)is output as the output video signal 101A to the signal conversionportion 38.

In ST417, similar to ST111, the video signal processing portion 34performs processing for enlarging the one parallax image (parallax image61L) of the two parallax images divided in ST416. A video signal basedon the parallax image 61La after enlarging processing is output as theoutput video signal 101A to the signal conversion portion 38.

In ST418, the same processing as ST112 of FIG. 6 is performed. That is,the signal conversion portion 38 superimposes the measurementinformation 102, which is generated in the image measurement processingportion 43, on the output video signal 101A based on the parallax image61La after enlarging processing and outputs it to the display portion 33as the display video signal 101 a. The display portion 33 displays theparallax image 61La on the basis of the display video signal 101 a. Thevisibility for the examiner can be raised by displaying one of the twoparallax images 61L and 61R. Although the parallax image 61L is used inthis example, the parallax image 61R may also be used.

In ST419, the same processing as ST114 of FIG. 21 is performed. InST420, the video signal temporarily stored in the image storage portion42 in ST411 is read as a measurement video signal and is output to theimage measurement processing portion 43 according to the control of thecontrol portion 45. This video signal is the same as the output videosignal 101A at the time of recording and is stored in the storage medium44 as a measurement video signal in ST407 of FIG. 27.

In ST421 to ST423, the same processing as ST115 to ST117 of FIG. 6 isperformed. That is, in ST422, the image measurement processing portion43 performs measurement processing using still image data based on themeasurement video signal read in ST420. Moreover, in ST423, the signalconversion portion 38 superimposes the measurement information 102,which is generated in the image measurement processing portion 43, onthe output video signal 101A from the video signal processing portion 34and outputs it to the display portion 33 as the display video signal 101a. The display portion 33 displays the parallax image 61L on the basisof the display video signal 101 a. In ST424, the same processing asST118 of FIG. 6 is performed.

As described above, according to the present invention, one parallaximage can be displayed independently of other parallax images byprocessing a video signal such that image data including an image fromany one optical system is extracted from image data including aplurality of images from a plurality of optical systems during a period(period including at least a point of time at which a measurement modestarts or a point of time at which a measurement result is generated byperforming measurement) regarding measurement. Accordingly, since thevisibility of a display image can be improved, it can be expected thatthe user would not be confused about performing an operation, such asinput of a measuring point, on which parallax image.

In addition, since the display portion also becomes small as theendoscope apparatus becomes small and light, the displayed size of animage from each optical system may become small if image data includingimages from a plurality of optical systems is displayed simultaneouslylike the related art. As a result, the visibility of a display image maybecome worse. On the other hand, according to the present invention, thevisibility of a display image can be improved by displaying one parallaximage independently of other parallax images. For example, since oneparallax image is enlarged and displayed by processing a video signalsuch that an image from one optical system is enlarged, the visibilityof a display image can be further improved.

Moreover, although it may be difficult for the examiner to compare aplurality of parallax images visually and to check the matching degreesince one parallax image is displayed independently of other parallaximages, the examiner can check the matching degree by displaying thematching degree among a plurality of images corresponding to themeasuring position.

While embodiments of the present invention have been described in detailwith reference to the drawings, the specific configuration is notlimited to the above-described embodiments but design changes and thelike within the scope without departing from the subject matter of thepresent invention are also included.

According to the present invention, since an image from one opticalsystem can be displayed independently of images from other opticalsystems by processing a video signal such that image data including theimage from the one optical system is extracted from image data includinga plurality of images from the plurality of optical systems during theperiod regarding measurement, the visibility of a display image can beimproved.

1. An endoscope apparatus comprising: a video signal acquisition portionthat images a test subject by a stereo optical system to acquire a videosignal; a video signal processing portion that processes the videosignal to generate a display video signal; a measurement processingportion that performs measurement on the basis of the video signal; adisplay portion that displays the display video signal; and a measuringposition input portion that inputs a measuring position based on thedisplay video signal, wherein the video signal processing portiongenerates the display video signal by extracting one image from thevideo signal including a plurality of images from the stereo opticalsystem, the display portion displays the display video signal includingthe one image extracted by the video signal processing portion during aperiod regarding measurement, the measurement processing portioncalculates a matching degree between the plurality of images at aposition corresponding to the measuring position, and the displayportion displays the matching degree together with the display videosignal.
 2. The endoscope apparatus according to claim 1, wherein thevideo signal processing portion outputs, as the display video signal,the video signal including the plurality of images from the stereooptical system when matching precision indicated by the matching degreeis equal to or less than a predetermined value.
 3. The endoscopeapparatus according to claim 1, wherein the measuring position inputportion inputs a measuring position again when matching precisionindicated by the matching degree is equal to or less than apredetermined value.
 4. An endoscope apparatus comprising: a videosignal acquisition portion that images a test subject by a stereooptical system to acquire a video signal; a video signal processingportion that processes the video signal to generate a display videosignal; a measurement processing portion that performs measurement onthe basis of the video signal; a display portion that displays thedisplay video signal; and an instruction input portion that inputs aninstruction for switching of a displayed image, wherein the video signalprocessing portion generates a first display video signal based on oneimage extracted from the video signal including a plurality of imagesfrom the stereo optical system, and a second display video signal basedon the one image and other image of the video signal, and the displayportion displays one of the first display video signal and the seconddisplay video signal during a period regarding measurement, in responseto an instruction input by the instruction input portion.
 5. Theendoscope apparatus according to claim 4, wherein when the seconddisplay video signal is generated, the video signal processing portionprocesses the video signal such that the one image is displayed so as tooverlap the other image.
 6. The endoscope apparatus according to claim4, wherein when the second display video signal is generated, the videosignal processing portion processes the video signal such that the oneimage is displayed so as to overlap the other image and the one image isenlarged.
 7. The endoscope apparatus according to claim 4, wherein whenthe second display video signal is generated, the video signalprocessing portion processes the video signal such that the other imageis displayed so as to overlap the one image.
 8. The endoscope apparatusaccording to claim 4, wherein when the second display video signal isgenerated, the video signal processing portion processes the videosignal such that the other image is displayed so as to overlap the oneimage and the other image is enlarged.
 9. The endoscope apparatusaccording to claim 4, wherein when the first display video signal isgenerated, the video signal processing portion processes the videosignal such that the one image is enlarged.
 10. The endoscope apparatusaccording to claim 9, wherein the video signal processing portionprocesses the video signal such that the entire one image is enlarged.11. The endoscope apparatus according to claim 9, wherein the videosignal processing portion processes the video signal such that apredetermined region of the one image is enlarged.
 12. The endoscopeapparatus according to claim 9, further comprising: a measuring positioninput portion that inputs a measuring position based on the firstdisplay video signal, wherein the measuring position input portioninputs the measuring position on the first display video signal enlargedby the video signal processing portion.
 13. The endoscope apparatusaccording to claim 12, wherein the period regarding measurement includesa period for which the measuring position input portion inputs themeasuring position.
 14. The endoscope apparatus according to claim 13,wherein the measurement processing portion performs measurement on thebasis of the video signal including the plurality of images from thestereo optical system.
 15. The endoscope apparatus according to claim 4,further comprising: a control portion that performs a control of storingthe video signal including the plurality of images from the stereooptical system in a storage medium.
 16. The endoscope apparatusaccording to claim 15, wherein the control portion reads the videosignal stored in the storage medium and makes the video signalprocessing portion generate from the read video signal the first displayvideo signal including the one image, the display portion displays thefirst display video signal, and the measurement processing portionperforms measurement on the basis of the video signal stored in thestorage medium.